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This application claims the benefit of provisional patent application Ser. 
Number 60/437,704 fried on December 30, 2002, which is incorporated in its entirety 
herein by reference. 

10 Background of the Invention 

The present invention describes a novel architecture for displaying images 
with multiple visual display devices using only a single video display controller. The 
present invention overcomes disadvantages in prior art multi-display systems which 
requires one video display controller for each display device, as shown in Fig. 1. 

15 Additionally, the existing multi-display systems require multiple frame buffer 

architectures and extensive software overhead to segregate images and bad them 
into the different frame buffers, which thus reduces overall system performance. 
Furthermore, in the prior art systems distinct image or video artifact occurs when the 
picture is displayed across the physical display boundary in both the x (horizontal 

20 arrangement) and y (vertical arrangement) directions. 

Summary of the Invention 

The present invention is directed at a multiple display architecture having a 
single video display controller. In one embodiment according to principles of the 

25 present invention, an M x N matrix display architecture includes M x N display 

devices, a single frame buffer and a single video display controller. The single video 
display controller can include M line buffer systems, where each of the line buffer 
systems have N line fetching systems and a data selector associated therewith. In 
an alternative embodiment the single video display controller can include M line 

30 buffer systems, where each of the line buffer systems have N line fetching systems 
and N data selectors associated therewith. The single video display controller can 
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additionally include a Time Division Multiplex Image Display algorithm for controlling 
the timing and operation of the video display controller. 

Brief Description of the Drawings 
5 Other features and advantages of the invention, both as to its structure and its 

operation, will best be understood and appreciated by those of ordinary skill in the art 
upon consideration of the following detailed description and accompanying drawings 
of preferred embodiments, in which: 

Fig. 1 illustrates a prior art multi-display architecture; 
10 Fig. 2 illustrates a multi-display architecture according to principles of the 

present invention- 
Fig. 3 illustrates a prior art circuit for implementing a 2 x 2 (M x N) display 
matrix video display controller; 

Fig. 4 illustrates a line fetching system used in the circuit and algorithm shown 
15 in Figs. 5 and 6; 

Fig. 5 illustrates an embodiment for implementing a 2 x 2 (M x N) display 
matrix video display controller according to principles of the present invention; 

Fig. 6 is an alternative embodiment for implementing a Time Division Multiplex 
Image Display (TDMID) algorithm video display controller in accordance with 
20 principles of the present invention; 

Fig. 7 is a representation of a line buffer system used in the circuit and 
algorithm shown in Figs. 5 and 6; and 

Fig. 8 illustrates an alternative embodiment of a multi-display architecture 
according to the present invention which can be implemented for wireless 
25 applications. 

Description of the Invention 

Referring to Fig. 2, a simplified representation of the new multi-display 
architecture 10 in accordance with principles of the invention is shown. As seen in 
30 the figure, a single frame buffer 12 and video display controller 14 combination is 
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employed to control the multiple display devices 16. In this first embodiment of the 
invention, the display devices are some type of LCD (liquid crystal display) type panel 
display device, plasma panel or organic LED (OLED) display. Current LCD types 
include but are not limited to TFT (Thin Film Transistor: active) displays and STN 
5 (Super Twisted Neumatics: passive) displays. 

Using this type of arrangement several advantages can be achieved. As can 
be seen, the system requires only a single Video Display Controller 14 for all the 
LCD, Plasma or OLED panels. Also as noted above, only a single Frame Buffer 12 is 
used in this architecture. Prior art systems were not intelligent enough to maximize 

10 the available memory bandwidth by using memory burst read/write technique and 
therefore cannot use a single Frame Buffer 12 architecture. The present invention 
also minimizes visual artifact when the picture is displayed across display device 
boundaries in both x and y-directions (both horizontal and vertical arrangement). 
Previous generations of display technology had no concept of zooming up a small 

15 image to a large screen and therefore could not implement the architecture according 
to the present invention. Because the present invention does not require segregation 
and loading of images into different areas of the frame buffer, overall chip 
performance is improved. This in turns saves tremendous memory bandwidth. The 
present architecture can be implemented using System On Chip (SOC) design 

20 approaches which results in reduced system level design with minimal components. 
Additionally, the advance of semiconductor technology going into very deep sub- 
micron geometry aids in reducing the system level design. Thus, the overall system 
cost is minimized due to reducing additional components used with each additional 
display device. 

25 The architecture in accordance with the present invention can also be used in 

a multiple Cathode Ray Tube (CRT) or TV display environment. The architecture 
shown in Fig. 2 is again employed, where the display devices 16 are CRT or TV type 
displays. In this application of the invention, the same advantages are achieved as 
those described above with respect to the use of multiple panel type display devices. 
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Now a novel circuit used in accordance with the present invention for 
implementing the single video controller 14 will be described. The circuit employs 
Line Buffers (LBs) for smoothly zooming-up images vertically in y-direction before 
sending the image data to the display devices 16. Each LB is an array of memory 
5 elements inside the chip and is used to store a portion of or the entire horizontal line 
of an image. The array is divided up into different segments which contain the image 
being displayed to each separate display device when ready. Referring to Figs. 3 
and 5, the prior art implementation required M x N LBs for anMxN display matrix, 
while the single video display controller according to the present invention requires 

10 only M LBs for the M x N display matrices. In both circuit designs, the size of the LBs 
can be the same. Fig. 3 illustrates the prior art circuitry 20 for a 2 x 2 (M x N) display 
matrix in accordance with the prior art implementation technique. As shown in Fig. 3, 
the prior art circuit 20 requires 4 (MxN=2x2=4) LBs 22 and 4 Line Fetching Systems 
(LFS) 24. In comparison, Fig. 5 illustrates the novel circuit 30 in accordance with the 

1 5 present invention, for a 2 x 2 (M x N) display matrix and requires only 2 (M=2) LBs 
32. 

Those of ordinary skill in the art can appreciate from the above example that 
certain advantages are provided by the circuit according to features of the present 
invention. As shown, the new circuit requires a lot less LBs (2 in current 

20 implementation verses 4 in prior art) which in turns saves a lot of area for other 

design blocks. For example, MxN display matrices, the new design requires M LBs 
while the prior art design uses MxN LBs. Additionally, since the new design uses 
less LBs, the overaU frame buffer access is less than before. The completion of 
these accesses depends on how fast the frame buffers can respond. The memory 

25 bandwidth is also dependent on the amount and response time of frame buffer 
accesses, and thus, the overall available memory bandwidth is increased 
substantially with the reduced frame buffer access. As a result, the system can run 
at a slower clock rate, dissipating less power while still maintaining the same image 
quality. The prior art design was more trivial and straightforward without worrying 

30 about the mechanics of control and de-multiplexing the output data to display devices 
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but it required software overhead to separate and toad images into different frame 
buffers. 

As seen in Fig. 5, the circuitry 30 for a video display controller in accordance 
with principles of the present invention includes multiple Line Fetching Systems (LFS) 
5 32, 2 Line Buffer Systems (LBS) 34 and 2 Data Selectors (DS) 36. Figs. 4 and 7 
show exemplary LFS 32 and LBS 34 structures, respectively, that can be used in the 
present invention. The DS 36 can be a logic block that consists of logic and data 
registers allowing, the image data to be sent to the display devices 16 in an orderly 
fashion complying with the display devices' requirement. Each DS 36 is controlled by 

10 the Time Division Multiplex Image Display (TDMID) algorithm, described herein 
below, to select which LFS 32 data to display. 

Referring to Fig. 4, the LFS 32 consists of a Memory Interface 322, a FIFO 
(First In First Out) storage element 324 and a Video Scaler 326. The Memory 
interface 322 is used to fetch image data from the frame buffer 12. The FIFO 324 is 

15 used to store part of or the entire line of the image data. The scaler 326 consists of 
logic circuitry to convert the resolution (size) of the incoming image to fit the display 
device resolution (size). A scaler can reduce the image size or expand the incoming 
image size depending on the relative incoming image resolution (size) verses the 
outgoing desired display resolution (size). As seen in Fig. 4, in accordance with 

20 principles of the present invention, the scaler 326 includes a horizontal scaler portion 
and a vertical scaler portion. The horizontal scaler portion processes the image data 
within the same line, while the vertical scaler portion processes the image data 
across 2 or more line boundaries. The LFS 32 is employed to transport and process 
data from the frame buffer memory 12 and fine buffer to the display devices 16. It will 

25 also write the data from frame buffer 12 and store into line buffer for processing the 
next line. There are M x N LFS 32 for M x N display matrices. Each LFS 32 
processes data in a line boundary and with hardware logic using the below described 
TDMID algorithm such that the display quality is guaranteed even when the line 
crosses the physical boundary from one display device to another display device in 

30 the horizontal direction. 
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Now, turning to Fig. 7, the LBS 34 includes a collection of data storage 
segments 342 for a dedicated dispfay fine type. For an M x N display matrix, there 
wilt be M LBS within the video display controller 14, where each LBS consists of N 
segments 342. Each segment supplies line data to the video scaler in the LFS 32 for 
5 vertical interpolation (mixing respective display pixels from different lines) as welt as 
for getting new tine data from the FIFO 324 of the LFS 32 as shown in Fig. 4. 

Referring now to Fig. 6, another embodiment of a video display controller 40 
for a M x N, in this case 2 x 2, display matrix, in accordance with principles of the 
present invention is shown, Here, a Time Division Multiplex Image Display (TDMID) 

10 algorithm 42 is used to control the timing and selection of image data to be displayed 
at the display devices 16. In addition to the TDMID algorithm 42, the video display 
controller 40 includes M horizontal dispfay matrices, where each horizontal matrix 
includes a LB 34, N LFS 32 and IM DS 36. The LB 34, LFS 32 and DS 36 can be 
implemented as described above 

15 The prior art implementation of a video display controller requires an 

independent horizontal scaler and independent vertical scaler for each of the display 
devices. Due to the independent nature of each of the respective scalers, there is 
significant image or video artifacts during the transition from one physical display 
boundary to another physical display boundary. Using a TDMID algorithm 42 

20 however allows the same scaling engine to generate the scaled up image and time 
division multiplex out to different physical display devices. This allows a smooth 
image transition without any calculation intensive operation or table fook-up 
technique to determine the correct scaling factors at the image boundary. 

Another advantage of the TDMID implemented video display controller 50 is 

25 that a huge data bandwidth is saved, tn a normal display pattern, data is sent to the 
display devices one row at a time horizontally across. The more pixels that the video 
display controller has to scan, the faster the required clock speed is. By using the 
TDMID algorithm 42, the operating clock speed does not change due to the 
expansion of the display device matrix (addition of display devices in the matrix). For 

30 example, the video display controller used in a 2 x 2 display matrix system operates 
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at the same dock speed as that in a 4 x 4 display matrix system assuming the same 
type of display devices are used in each configuration. Each segment of the display 
devices operates at virtually the same time without waiting for the previous display 
device segment to finish. This reduction in operating frequency results in power 
5 savings and minimizes the FCC regulated Electro Migration Interference (EMI) effect 
within the system. 

By comparison, in the prior art implementation, a display matrix displaying.an 
image resolution of 1980 x 1080 at 60: framesper second requires a clock speed of, 
or about, 160 MHz. When the same set of display devices operates at 72 frames per 

10 second to avoid visual flickering effect, it has to operate at a clock speed of, or about, 
192 MHz. Another disadvantage of the prior art system is that a primitive timing 
controller is required to generate a primitive set of timing control parameters to 
control all the display devices. Each of the display devices has to use this same 
primitive set of timing control parameters at the same time. Thus, there could be no 

15 flexibility in the design. In comparison, the TDMID design set forth by the present 
invention allows for each display device to use the timing control parameters 
differently at different times, while stilt maintaining a simple timing controller design. 

The Time Division Multiplex Image Display (TDMID) algorithm is a simple but 
orderly way to send the divided image to different display devices so that it will 

20 share/eliminate hardware (i.e.' line buffers). The TDMID algorithm 42 controls when 
to enable the Line Fetching Systems (LFS) 32 at different times to fetch image data 
and controls how the data from each LFS 32 are sent to the different display devices 
16. For M x N display matrices, the TDMID hardware is divided into M identical 
horizontal display matrices. Each horizontal display matrix contains one line buffer 

25 34 (divided into N segments), N Line Fetching System (LFS) 32, and N Data Selector 
(DS) 36 for each display devices. Each DS 36 is controlled by the TDMID 42 to 
select which LFS 32 data to display. By working with the TDMID 42, this DS 36 has 
more complicated logic to supportthe complexity of TDMID selection scheme as 
compared with the prior art implementation without the TDMID. 
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The TDMID algorithm 42 controls the timing and data flow to the display 
devices 16 in the following manner. At time t, the first LFS will fetch and send image 
data to the first display device. At the end of the display line of the first device at t + 1 
line, the first LFS will send image data to the second display device. At the end of 
5 the display line of the second device at t + 2 line, the first LFS will send image data to 
the third display device, and so on until N display device. At time t + 1 line + display 
blanking time, the second LFS will start processing the second line image data and 
send the data to the first display device. At time t + 2 line + display blanking time, the 
second LFS will send the processed data to the second display device, and so on 

10 until N display device. At time t + 2 iine*+* display blanking time; the third LFS will 
start processing the third line image data and send the data to the first display device. 
At time t + 3 line + display blanking time, the third LFS will send the processed data 
to the second display device, and so on until N display device. All the H LFS will use 
the same procedure for process N data lines. At time t + N line + display blanking 

15 time, the process will repeat with the first LFS. 

The following tables illustrate the timing and data flow described above for an 
exemplary 2x2 display matrix using the TDMID algorithm of the present invention. 
The total number of lines per image that will be displayed across all four display 
devices = 2y. Each of the display devices will display % of the vertical lines and !4<jf 

20 the horizontal portion of the image. 
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Display 1,1 


Display 1,2 


Display 2,1 


Display 2,2 



2x2 Display Device Matrix 





Display 1,1 




Display 1,2 


Time = t 


Display Line # 1 
(from top. even LFS) 


Time = t + 1 line 

- blanking time 


No Display 


Time ■ t + 1 fine 


No Display 


Time = t + 1 fine 


Display Line # 1 
(from top, even LFS) 


Time = t + 1 line 

+ 1 blanking time 


Display Line #2 
(from top, odd LFS) 


Time = t + 2 fine 


No Display 


"Time = t + 2 line 

+ blanking time 


No display 


Time = t + 2 line 

+ Wanking time 


Display Line # 2 
(from top, odd LFS) 


Time = t + 21ine 

+ 2 blanking time 


Display Line #3 
(from. top, even LFS) 


Time = t + 3 line 

+ blanking time 


No Display 


Time » t + 3 line 

+ 2 Wanking time 


No Display 


Time » t + 3 line + 

+ 2 Wanking time 


Display Line # 3 
(from top, even LFS) 


Time = t + 3 line 

+ 3 blanking time 


Display Line #4 
(from top, odd LFS) 


Time » t + 4 line + 

+ 2 blanking time 


No Display 


Tune = t + 4 line 

+ 3 Wanking time 


No display 


Time » t + 4 line 

+ 3 blanking time 


Display Line # 4 
(from top, odd LFS) 
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Display 2,1 




Display 2,2 


Time = t 


Display Line # y+1 
(from bottom, even LFS) 


Time - 1 + 1 fine 

— blanking time 


No Display 


Time = t + 1 line 


No Display 


Time = t + 1 line 


Display Line # y+1 
(from bottom, even LFS) 


Time *t + 1 fine 

+ 1 blanking 

time 


Display Line # y+2 
(from bottom, odd LFS) 


Time ■ t + 2 fine 


No Display 


Time =t + 2 fine 

+ blanking time 


No display 


Time = t + 2 fine 

• i-, t— — t r ;_ i; n ii n 

~r otarnuny urne 


Display Line # y+2 
(from bottom, odd LFS) 


Time = t + 2 fine 

+ <l Dianxtng 

time 


Display Line # y+3 
(from bottom, even LFS) 


Time = t + 3 line 

+ blanking time 


No Display 


Time « t + 3 fine 

+ 2 Wanking 

time 


No Display 


Time = t + 3 line + 

+ 2 blanking time 


Display Line # y+3 
(from bottom, even LFS) 


Time ~t* 3 fine 

+ o otanKing 

time 


Display Line # y+4 
(from bottom, odd LFS) 


Time = t + 4 line + 

+ 2 blanking time 


No Display 


Time = t + 4 fine 

+ 3 Wanking 

time 


Na display 


Time * t + 4 line 

+ 3 blanking time 


Display Line # y+4 
(from bottom, odd LFS) 











Tables showing the display sequence of the 2x2 Display Device Matrix 
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Another aspect of the multi-display, single display controller architecture of the 
present invention is using removable and interchangeable storage elements as frame 
buffers. Here, users select the appropriate storage medium for their image or video 
content. Thus, users can choose whichever available storage media at the time for 
5 the sake of cost, size and availability of the media. The prior art implementation uses 
fixed memory elements such as memory IC for the ease of design. In accordance 
with the present invention, the frame buffer size can increase indefinitely which 
means unlimited amount of image or video content can be accessed and displayed 
on the display devices, In comparison, the prior art implementation has a fixed 

10 amount of memory storage because previous designers assume the image size is 
fixed. In real life, however, image size can vary dramatically such as the image size 
from a 3.0 Mega Pixel Camera is 3 times that of a 1.0 Mega Pixel camera. 

Other advantages can be achieved by using removable and interchangeable 
storage media as the frame buffers. For instance, the storage media can be 

15 preloaded with user image or video, which can be accessed and displayed 
automatically by the Video ControHer periodically without any user interaction. 
Additionally, using such an implementation, the frame buffer can be a totally 
integrated system and can be a standalone portable solution such as in a PDA 
application. Again, as discussed above, the number of additional components is 

20 reduced, thus minimizing the ovefatt system cost. 

A still further alternative embodiment of a multi-display, single video controller 
architecture 50 can be seen in Fig. 8, where a wireless interface device 52 is 
employed for the frame buffer. As in the case with the removable or interchangeable 
storage media, users can select an appropriate wireless interface device 52 for their 

25 image or video content. This approach allows the device to fetch data from a 

wireless system and acts as an initiator as opposed to being a receiver like the TV 
display. This allows any up-to-date image and Video content to be accessed and 
displayed in real time, and no preloading of any image or video content is necessary. 
Additionally, image or video content can be stored in the Wireless Interface Device 

30 52 for repeated display to the displayed devices. In this embodiment, the multi- 
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display architecture 50 also includes a single video display controller 54 for 
controlling the multiple display devices 16. The single video display controller 54 can 
be implemented using the circuits described above with respect to Figs. 5 or 6. 

Using a wireless interface device for the frame buffer has many of the same 
advantages as those discussed above with respect to the removable and 
interchangeable storage media frame buffers. As in the above embodiment, the 
frame buffer size can be infinite Which means an unlimited amount of image or video 
content can be accessed and displayed on the display devices, user image or video 
which can be accessed and displayed automatically by the video controller 
periodically without any user interaction, the wireless interface device can be a totally 
integrated system and a standalone portable solution and, as in the other 
embodiments described hereinabove, the overall system cost is minimized by 
reducing the amount of additional components. 

Having thus described various embodiments of the invention, it will now be 
understood by those skilled in the art that many changes in construction and circuitry 
and widely differing embodiments and applications of the invention will suggest 
themselves without departure from the spirit and scope of the invention. The 
disclosures and the description herein are purely illustrative and are not intended to 
be in any sense limiting, Rather, the invention is to cover all modifications, 
equivalents, and alternatives falling within the spirit and scope of the invention as 
defined by the appended claims. 
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